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Abstract 

For a C 2 -functional J defined on a Hilbert space X , we consider the set 
TV = {x G A : proj v VJ(i) = 0}, where A C X is open and V x C X is a 
closed linear subspace, possibly depending on x £ A. We study sufficient 
conditions for a constrained critical point of J restricted to A/" to be a 
free critical point of J, providing a unified approach to different natural 
constraints known in the literature, such as the Birkhoff-Hestenes natural 
isoperimetric conditions and the Nehari manifold. As an application, we 
prove multiplicity of solutions to a class of superlinear Schrodinger systems 
on singularly perturbed domains. 

1 Introduction 

Let X denote a Hilbert space and let J be a functional of class C 2 on X. 
A natural constraint for J is a manifold M C X enjoying the property that 
every critical point of J constrained to N is in fact a free critical point. When 
searching for critical points of J, natural constraints are typically used when J 
does not admit (nontrivial) minima. 

According to Birkhoff and Hestenes [I], the first example in the literature 
appears in a paper by Poincare [TH] in the study of closed geodesies on a closed 
convex analytic surface. Since such a geodesic can not be of minimal length, 
Poincare finds it by minimizing the length functional among paths which satisfy 
the "natural isoperimetric condition" of dividing the surface into two parts of 
equal integral curvature. The aforementioned paper by Birkhoff and Hestenes 
is the first which considers natural constraints from an abstract point of view. 
In particular, for the fixed end-point problem in the calculus of variations, the 
authors prove that every extremal of the functional is indeed a local minimum 
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when a suitable set of natural conditions is added. In modern language, these 
conditions can be written as 

(VJ(x),&)=0, 

where the variations £j's are related to the second variation of </, and their 
number is the Morse index of the extremal. 

In more recent times, apart from natural constraints induced by symmetry 
[16] , the development of this topic followed mainly two directions. On one hand, 
the ideas of Birkhoff and Hestenes were exploited by Berger [3] in searching for 
periodic orbits to Hamiltonian systems, and by Berger and Schechter [5] from 
a more abstract point of view. In these papers V J has a semilinear structure, 
while the natural constraint is 

■A/b-s = {x € x : (VJ(x),«) = for every v eV} 

where V C X is a closed linear subspace such that J"{x) is definite on V for 
every x G A/b-s- This implies both that A/b-s is a manifold and that it is a 
natural constraint, because for any constrained critical point the corresponding 
Lagrange multiplier is zero. On the other hand, one of the most famous examples 
of natural constraint is the so called Nehari manifold 

A/jsr = {x e X : x ^ and G(x) := (VJ(x), x) = 0} , 

which is named after the papers by Zeev Nehari [T3l [TJl [15] . Again, since 

(VG(x),x) = (VJ(x),x) + J"(x)[x,x], (1.1) 

if J"(x) along x is non-degenerate for every x € A/", then both A^ is a manifold 
and it is a natural constraint (see for instance [TJ, Proposition 1.4). 

As we mentioned before, a natural constraint Af is particularly useful when 
searching for non-minimal critical points, which are minima of the restricted 
functional, so that one expects to find critical points of J by minimizing J\j^. 
From this point of view, the two types of natural constraints introduced above 
behave in a quite different way. While A/b-S is often weakly closed, so that the 
direct method of the calculus of variations usually applies, on the other hand 
A/isr needs not be, thus exhibiting a lack of compactness. The typical strategy 
to overcome this difficulty is to provide a sort of "projection" of X \ {0} into 
A/isr, such as u i y i(u)u, where i(u) € R is conveniently chosen by studying the 
critical points of the function t J(tu). In this direction, the main problems 
arise when a globally defined projection is not available. An alternative way to 
proceed is to show that Jlwk satisfies the Palais-Smale condition. To this aim 
it is sufficient to require that the non-degeneracy of J" holds uniformly on A/n 
in the sense that 

either j"(x)[x,x\ > S\\x\\ 2 or j"(x)[x,x] < -<5||x|| 2 , (1.2) 

for some 5 > 0, for every x 6 A/jsr- Indeed, under such assumption, one can 
prove that constrained Palais-Smale sequences are free ones. This allows to 
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recover compactness by assuming the usual Palais-Smale condition on J (see 
for instance [TTj). 

In the literature it is possible to find a number of generalizations of the 
above ideas: when searching for points such that VJ(s) = 0, one imposes as a 
preliminary condition the vanishing of the projection of VJ(x) on some closed 
subspace V x C X, possibly dependent on x. This is the case of the classical 
Nehari manifold, since 

(VJ(x),x)=0 proj spanM VJ(x) = 0. 

Among others, we wish to mention [25 1 |I51 |2H |T7H201 |I21 125 1 123 ) . 

The main aim of the present paper is to provide conditions in order to extend 
the above scheme to the constraint 

N = {x e A : G(x) := pmi v VJ(x) = 0}, 

where A C X is open and V x C X is a closed linear subspace, for every x € A. 
Referring to (|l.ip and (|1.2p . the main feature we want to preserve is that the 
differential of G restricted to V x consists of two terms, one of which vanishes on 
TV, and the other one is a quadratic form related to J", enjoying some coercivity 
property. It will come out that, apart from some regularity conditions, we will 
need two main properties, namely that 

• V x is invariant under differentiation, in the sense that the differential of 
any regular vector field laying in V x for every x maps V x into itself; 

• V x splits into two subspaces V^, with the property that J"(x) is coercive/ 
anticoercive on respectively. 

We stress the fact that, with respect to the previous literature, we do not require 
J" to be definite on V x ; this allows a better localization of the critical points, 
as we show in our application to nonlinear Schrddinger systems. To express the 
dependence of V x on x, it is useful to introduce a vector bundle structure on 
V, the disjoint union of V x . To do that, we denote by TA the (trivial) tangent 
bundle of A. In the following we are interested only in trivial C 1 -subbundles 
of TA, that is bundles V A, with V C TA, equipped with a global C 1 - 
trivialization 

r : V -> A x V, 

for some Hilbert space V. With this notation, V x is the fiber of V at x which 
is isomorphic to V via r x :— t(x, •). We observe that, by means of the natural 
immersion which we will systematically omit, r _1 can be naturally interpreted 
as a C 1 map 

t- 1 : A x A x X. 

With this notation, the regularity assumptions we mentioned above concern 
dxT^ 1 , besides J' and J" . Our main result is the following. 
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(1.1) Theorem. Let X be a Hilbert space and let J e C 2 (X,R). For A C X 
open, let be two trivial C 1 -subbundles of T A, with fibers and trivializa- 
tions t ± respectively, which we assume to induce isometries on every fiber. 
Suppose that C\V~ = {0} and that V := V + + V~ is such that V x is a proper 
subspace ofT x A. Set 

N := {x e A : proj yx VJ(a;) = 0} 
and assume that there exists S > such that, for every x e TV, it holds 
(inv) £'(x)[v] £ V x for every (■,£(■)) C 1 -section ofV, v e V x ; 
(coe) ±J"(x)[v,v] > f or every v e . 

Furthermore, assume that J'(x) e X* , J"(x) : X x X -> R, and ^(t^) -1 : 
V 1 * 1 x X — > X are bounded as linear /bilinear maps, uniformly for x in N ' ■ 

Then N is a natural constraint for J , and every constrained Palais-Smale 
sequence for J is indeed a free one. 

We stress the fact that the above theorem can be exploited in order to obtain 
the existence of critical points for J, without the need of defining any global 
projection of A onto N. 

To better clarify the assumptions above, one can consider the particular 
case (which includes most applications) in which V x is constant, except for a 
finite dimensional subspace. That is, let us consider a fixed closed subspace 
W C X, and & € C 1 (A,X), i = l,...,fc, an orthonormal set, with W n 
span{£i(x), . . . ,£k(x)} — {0} and let us set 

V x = We span {&(*),..., &(jc)}. 

In such a situation, V x induces a C 1 -subbundle of TA with fiber V = W x R fe 
and trivialization 

t x v = (proj w w, (v,£i(x)},.. . , (v,€k{x))). 
As a consequence, t x is trivially an isometry and 

k 

d^y 1 : {(w,ti, . . .,t k ),u) i ^ ^2ti&(x)[u] 

i=l 

is uniformly bounded as a bilinear map on V x X whenever the linear operators 
£'i(x) : X — > X are. Finally, assumption (inv) can be more explicitly written as 

£i( x )M € V x for every v G V x , 1 < i < k. 

One of the main advantages of the method of natural constraints with respect 
to other variational methods, such as mountain pass or linking theorems, is that 
it allows to better localize the critical points, thus providing a deeper qualitative 
description. This is particularly advantageous when facing multiplicity issues. 
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To illustrate this point, in the second part of the paper we apply the above result 
in order to prove multiplicity of solutions to a class of elliptic systems of gradient 
type with superlinear nonlinearities, in singularly perturbed domains. Despite 
the fact that we can deal with more general situations, in this introduction we 
describe our results in the case of cubic nonlinearities in a smooth bounded 
domain of M. N , with N = 2,3. Such type of nonlinearities have been extensively 
studied in the recent years, due to their applications both to nonlinear optics 
and to Bose-Einstein condensation. Let us consider the system 

- Am = Hjuf + Uj y] PijUj, Ui > 0, Ui G flo(fi), i = l,...,k, (1.3) 

where \ii > 0, (3^ — /3ji G M, for every At least in some particular cases, 
system (11.31) is well known to admit positive solutions with minimal energy, see 
for instance [7J |H1 E] ■ We aim at extending to (|1.3[) the results first obtained 
by Dancer in the case of a single equation, concerning the effect of the domain 
shape on the multiplicity of solutions, see [9j [10]. While in these papers the 
tools are mainly topological, a variational approach to the single equation case 
has been introduced by Beyon in [5]. We prove the following. 

(1.2) Theorem. Let Q and Qi, I — 1, ... ,n, be bounded regular domains such 
that 

n 

Qi n f2 ro = for every 

i=i 

where D is a bounded regular open set which is sufficiently small in a suitable 
sense. If < f3 for every i ^ j, with j3 > sufficiently small, then system 
p.3[) admits at least (2" — l) k positive solutions. 

We distinguish the solutions because, using suitable natural constraints, we 
can prescribe whether Ui\n t is either large or small, for every i = l,...,fc, 
I = 1, . . . ,n. Note that, in particular, our result holds true in the purely com- 
petitive case, i.e. /3y < 0. The smallness of D will be made precise by suitable 
assumptions in the following; for instance, the result holds if D can be decom- 
posed in a finite number of parts, each of which lies between two hyperplancs 
sufficiently close. We wish to mention that related systems in similar domains 
were considered, from a different point of view, in [6]. 

Notations. Given I G C k (X 1 Y), k > 1, with X and Y Hilbert spaces, 
and xo,u G X, we write I'(xo)[u] E Y to denote the (first) differential of / 
evaluated at xo along u. Analogously, I"(xq)[u, v] G Y will denote the (bilinear 
form associated to the) second differential along (u, v) £ X x X. In case Y = M, 
a sequence {x n } n C X is a Palais-Smale (PS) sequence for / (at level c) if 

I(x n )-*c and I'(x n ) -> in X*. 

I satisfies the PS-condition (at level c) if every PS-sequence admits a converging 
subsequence. We say that a subspace V C X is proper if V ^ {0} and V ^ X. 
The orthogonal projection of a vector u G X on V will be denoted by proj^u. 
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For fi C M. N smooth bounded domain, L c dfl relatively open and p < 2* := 
2N/(N — 2) we denote by Cs(f2,p) (resp. Cs(0,,T,p)) the Sobolev constant 
related to the embedding of Hq(Q) (resp. iJp r (f2)) into L p (fl). Finally, we 
denote by C any constant we need not to specify. 

2 Generalized Nehari manifolds 

2.1 Palais-Smale sequences on natural constraints 

Let X, Y be Hilbert spaces, A C X open and G e C 1 {A,Y). We denote by Af 
the zero set of G, that is 



Let us recall a well known condition which ensures that Af is a manifold. 

(2.1) Proposition. Let G € C 1 (A, Y). If for every x € TV, G'(x) is surjective 
and ker(G"(a;)) is a proper subspace of X, then Af is a C 1 -manifold and the 
tangent space to Af at x is ker(G"(x)). 

Sketch of the proof. Being ker(G'(ai)) a closed and proper linear subspace, we 
have the nontrivial splitting X — ker(G"(x)) © ker(G"(x))- L . Now, since G'(x) : 
ker(G'(x)) ± — > Y is bijective, the implicit function theorem applies and this 
provides a local parametrization of Af around x. □ 

Our first aim is to establish some general conditions under which Af is a 
natural constraint for a functional J defined on X. 

(2.2) Proposition. Let J E C 1 (X,R), G € C 1 (A,Y) and let Af be defined as 
above. Let us assume that 

for every x £ Af there exists a closed and proper linear subspace V x C X 



Then Af is a manifold and a natural constraint for J . 

Proof. Let us first show that ker(G'(j:)) is a proper subspace of X, so that, by the 
previous proposition, Af is a manifold. Clearly ker(G'(x)) can not be the entire 
space, by (|2.5p . Let ^ V\ € Vj- (which exists since V x is proper). By (|2.5I) 
there exists V2 £ V x such that G'(x)[vi] = G'(x)[v2], hence v\ — w 2 € ker(G'(x)). 
We turn to the second part of the statement. Let iro € Af be a critical point of 
J constrained to Af. Then there exists a Lagrange multiplier A € Y* such that 



Af:={xE A: G(x) = 0}. 



such that 



J (x)\v x is identically zero; 
G [x)\v x is surjective onto Y. 



(2.4) 
(2.5) 



J'(x )[x] = A [G'(x )[x] 



for every x £ X. 
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In particular we have 

A [G'(x Q )[v]} = J'(x Q )[v] = for every v G V xo , 

and being G'(cco) surjective on V Xo we deduce that A = 0, i.e. xq is a free critical 
point of J. □ 

When searching for critical points of J, a typical strategy consists in selecting 
a candidate critical value via some variational principle, and then to exploit some 
compactness, usually in the form of a Palais-Smale condition. Since on natural 
constraints free critical points coincide with constrained ones, it is natural to 
wonder if a similar equivalence holds for Palais-Smale sequences too. It comes 
out that, in our setting, while the first property depends on the surjectivity of 
G'\v, the latter one leans on the uniform injectivity of the same operator. 

(2.3) Proposition. Under the assumptions of Proposition \2.'A let us assume 
moreover that there exist positive constants p, p' , such that 

||G (a;)[u]||y > p|H|x for every x G TV, v G V x , (2-6) 
\\G'(x)[u]\\ Y < p'\\u\\ x for every x e TV, u G X. (2.7) 

Then, for every sequence {(x n , A„)} C TV X Y* , 

J'(x n ) - A„ o G'(x n ) -> inX* J'[x n ) ->■ in X* . 

Proof. By definition we have 

\J'(x n )[u]-X n [G'(x n )[u]]\ 

sup — = || J (x n ) - A„ o G (x n )\\x* -> 0. 

u£X \\u\\x 

Since J'(x n )[v] = for every v G V^„, we deduce that 

sup \^'MM\^ Q 

vev Xn \\v\\x 

Now, recalling that G'(x n ) restricted to V Xn is surjective, we deduce that 

IHH \±M \X n {G'(x n )[v]]\ ^ 1 |A»[G'(z»)M]| >n 
An V* = sup = sup — — < - sup — > 0. 

yer \\y\\Y vev„ n \\G'{x n )[v\\\ Y Pvev Xn \\v\\x 

Finally, the uniform continuity implies 

\X n [G'(x n )[u]]\ ^ |n „ ||G , (^)MI|y . „ u || 

SUP jj-jj < A„ y. SUp jj-jj < p A„ y» , 

which concludes the proof. □ 
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Under standard additional assumptions, the previous result ensures the ex- 
istence of a critical point of J belonging to Af. 

(2.4) Corollary. In the assumptions of Propositions \2.2\ and \2.3l suppose 
moreover that 

inf J(x) > inf J(x) =:c£l 

and that J satisfies the Palais-Smale condition at level c. Then there exists 
xq £ Af such that J(xq) = c and J'(xq) = 0. 

Proof. By Ekeland's variational principle .22] applied to Af there exists {x„} C 
Af and {A„} C Y* such that 

J(x n ) — > c and J'(x n ) — A„ o G'(x n ) —> in X* 

asn^ +oo. By the previous proposition J'{x n ) — ¥ in X*, and the conclusion 
follows in a standard way. □ 

(2.5) Remark. In order to prove the previous result it suffices to assume con- 
ditions (|2.6j) and (|2.7[) only on minimizing sequences. 



2.2 Proof of Theorem 

A remarkable particular case of the structure just introduced is when the closed 
linear subspaces V x depend in a smooth way on x and G{x) is the projection 
of VJ(x) onV x . In this case, assumption (|2.4p on J' is tautologically satisfied, 
while we will show that assumption (|2.6p on G" can be expressed in terms of 
J", in case the subspaces arc invariant under differentiation. 
In view of the application of Proposition 12. 3[ we set 

Y := V+ x V-, (y,z) Y ~ (y + , z+) v+ + (y-,*-)v-> 
G:A^Y, G(x) := (G+(x),-G-{x)), 

where y ~ (y + , y~), z = (z + , z~) and 

G ± (x) := r^proj y ±VJ(a;), 

so that the set Af which appears in the statement of Theorem 11.11 is indeed 
the null set of G. Notice first that since are C 1 -subbundles of TA, then 
G € C 1 (A,Y). As a consequence we can evaluate G'(x), first along directions 
in V x and next along directions in X. 

(2.6) Lemma. For every x £ Af, v + £ V% , w £ V x it holds 

{(G+y(x)[w},r+v + ) Y+ = J"(x)[w,v+] 
(and an analogous property holds for G~ ). 



8 



Proof. Let £(x) = {t+)~ 1 t£v + . Note that (•,£(•)) is C 1 -section of V+ , i.e. 
£(#) G V^T" for every a; G A, and £(x) = v + . By definition of projection we have 
that 

(G+(x),t+v+) y+ = (proiy+VJ(x),t(x))x 
= (VJ(i),J(i)) x . 

By differentiating the previous expression at x, along w G V^, we obtain 

((G+)'(S)M,t+«+) v+ - J"(5)[^,f)+] + (VJ(x),£\x)[w]) x , (2.8) 

where the last term vanishes because of assumption (inv). □ 

(2.7) Lemma. There exists a positive constant p' such that for every x G M 
and u G X it holds 

\\G'(x)[u]\\y<p'\\u\\ X . 

Proof. To start with, we claim that there exists a positive constant p" such that 
for every x G Af, v + G and u G X it holds 

|((G+)'(aOM,T>+) v+ | <p> + ||xN|x, 

and an analogous property holds for G~. Indeed, reasoning as in the previous 
lemma, we have that (|2.8p holds with u £ X instead of w G V x . The claim 
follows, recalling the definition of £, by the assumptions of uniform boundedness 
on J', J" and d x (t x ) ~~ 1 . Now, by isomorphism, vectors g ± G V^r are uniquely 
determined so that G'(a;)[u] = T+g + + t~ g~ . With this notation we have 

\\G'(x)[u]\\ 2 Y = ((G+y(x){u},T+g+) Y ((G + y(x)[u},r-g-) Y 

< P"\\u\\x(\\g + \\x + \\g-\\x) = P"\\u\\x(\\r+g + \\ v+ + \\r-g-\\y-) 

< V2p"\\u\\ x ■ \\t+ 9 + + T-g-\\ Y = p'\\u\\ x ■ \\G' (x)[u]\\y . 

□ 

We notice that induce a global G 1 -trivialization r : V — > A x Y, with 
fiber 

t x : V + + V~ — > Y, t x :v + +v-^ (t+« + , r~V~). 

Even though r x needs not to be an isometry, we have that (r+w + , t~v~) y = 
for every G , and hence 

I|rx* = ||« + Ili + Il«-Il^>5ll* 

Proof of Theorem ] 1. 11 We apply Proposition 12.31 to our context. Assumption 
(|2.4p holds by definition, since J'(x) identically vanishes along vectors of V x . 
As it regards (|2.5[) . for fixed x G A/", y G V, we search for iu G 14 such that 
G'(a;)[w] = y. This is equivalent to solving the abstract variational problem 

a(w, v) = (y, T x v)y for every v € V x , 
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where a(w, v) is the following bilinear form on V x 

a(w,v) := (G'(x)[w],t x v)y 

= ((G + )'(x)[w},r+v+) Y+ - ((G-)'(x)[w},t-v-) v - 
= J"{x)[w,v+]- J"(x)[w,v~] 

(in the last equality we used Lemma |2.6[) . Such a problem can be easily solved 
by applying Lax-Milgram Theorem, since a(w, v) is bounded by Lemma 12.71 and 
it is coercive because 



a(v, v) — J" (x)[v + 1 v + ] — J"(x)[v ,v } 

£ 
2 



>5(\\vn x + \\v-f x )=5\\r x v\\ Y >-\\vf x , 



where we used the fact that J"(x) is symmetric and assumption (coe). The last 
calculation also provides the validity of (|2.6I) as follows 



\\G'(x)[v}\\ Y • \\t x v\\ y > a(v,v) > S\\t x v\\ 2 y > ^=\\v\\ x • \\t x v\\ y . 

Finally, (|2.7|) was proved in Lemma |2"771 so that all the assumptions of Proposi- 
tion O hold true. □ 



To conclude the section we provide a version of Theorem 11.11 specialized to 
the applications we will present next. 

(2.8) Theorem. Let X be a Hilbert space, J e C 2 (X,R), V + C X a fixed 
closed linear subspace. We define 



V+ = V+, V- := span (*),•••,&(£)}, V x :=V+®V a 



with Ci G G (A, X) for every i = 1, . . . , h, A C X open, in such a way that V x 
is proper. As usual, let 

N {x <^ A: projy^ V J(x) — 0} and c := inf J. 

Let us suppose that 

(i) ceR, Mjj^tfJ > c; 

(ii) J satisfies the PS-condition at level c. 

Moreover, let us assume that for some < 6 < 5' there holds, for every x € Af 
with J(x) < c + 1, 

(Hi) Ui(x)\\ x > 5, (£i(x),£j(x))x = 0, for every i ^ j; 
(iv) £'i(x)[v] € V x for every i and »e V x ; 
(v) ±J" (x){v,v] > (511^11^ for every v £ V^; 
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(vi) \\Zl(x)[u]\\x < S'\\u\\x, \J'(x)[u}\ < S'\\u\\ x and\J"(x)[u,w}\ < S'\\u\\ x \\w\\ x 
for every u,w £ X. 

Then there exists Xq £ Af such that J(xq) — c and J'(xq) = 0. 

Proof. First of all, by virtue of Remark 12.51 we can work in the sublevel of J. 
We choose 

V+:=V + , ¥~ :=R h 

(which have trivial intersection by (v)), and r+ to be the identity, t~ : V x — > M. h 
defined as 

x I \\ti(x)\\x nawiu 

In particular, assumption (iii) immediately implies that t~ is an isometric iso- 
morphism. Taking into account Theorem 11.11 and Corollary 12. 4[ the only non- 
trivial things to check are that assumption (inv) holds and that (^(t") -1 is 
uniformly bounded as a bilinear map on V~ x X. On one hand, if £(x) — 
Ei ti( x )£i( x )> then for any v £ V x it holds 



i=l 



where the first term belongs to V x , while the second one is an element of V x by 
assumption (iv). On the other hand, if t £ M. h and u £ X, then 



d x (r x ) 1 : (t,u) i-> 



which is uniformly bounded by assumptions (iii) and (vi). □ 

3 Superlinear elliptic systems 

In this section we apply Theorem 12.81 in order to obtain multiple positive solu- 
tions for the system 

- Am — diF(ui, . . . , u fe ), i = l,...,k, (3.9) 

where every Ui is Hq on a bounded regular domain ft C M. N . We stress that, with 
"positive solutions" , we mean that every component Ui must be non negative 
and non identically zero. We denote by ei, . . . , et the canonical base of R fe , so 
that 

u = (ui, ...,u k ) = y^^Ujej. 

i 

Throughout this section we will assume that F £ C 2 (R fc , R) and that there exist 
p £ (2, 2*), Cf > and S > such that, for every u, A £ R fe , it holds 

(Fl) Eij I^WI < C f \u\p- 2 , £. |a ( F( u )| < C F M P_1 and |F(u)| < Cf|«|f; 
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(F2) Eij dijF(u)XiUi\jUj -(1 + 5) > 0; 

(F3) diF(u)ui < diF(uiei)Ui for every i; 

(F4) for every i there exists > such that diF(uiei) > . 

Assumptions (F1),(F2) and (F4) are quite standard when searching for solutions 
of elliptic problems with variational methods, even in the case of one single 
equation. As it concerns (F3), it can be slightly weakened (see the proof of 
Theorem 11.21 at the end of the paper) , and completely neglected in case one 
admits solutions with some vanishing components (see Remark 13. 4[) . Under 
these assumptions one can easily obtain some further inequalities, such as the 
classical Ambrosetti-Rabinowitz condition 

V-F(u) • u - (2 + S)F(u) > (3.10) 

(notice that, by (F2), the function 1 1-> VF(tu)-tu—(2+5)F(tu) is nondecreasing 
for t € (0, 1)) and 

Q 771/ \ ^ diF(Uiei)Ui 2+5 r ^ - /o 11\ 

diF(uiei)ui > -^q-j for m > u t (3-11) 

(again by (F2), the function t h- > diF(tei)t/t 2+s is nondecreasing for t > 0). 
Notice that the solutions of (|3.9p can be seen as critical points of the energy 
functional 

J(u) = - I \\7u\ 2 dx~ I F(u)dx. 

It is standard to prove that J € C 2 {X,R) where X := H^(Q,,R k ) is endowed 
with the norm ||w|| 2 = J n \Wu\ 2 dx = Yli Jn l^ u i| 2 dx. Since we search for 
positive solutions, we assume without loss of generality that F is even with 
respect to each component. All solutions will be found as minimizers of J 
on suitable even constraints. By standard arguments we obtain that, for any 
minimizer [u\, . . . ,Uk) with it, ^ 0, then also (|lti|, . . . , \Uk\) is a minimizer, 
which components are strictly positive by the strong maximum principle. For 
this reason, with a slight abuse, from now on we will work only with fc-tuples 
having non-negative components. 

3.1 Ground states 

We start investigating the existence of ground state solutions. Such a problem 
has already been successfully faced in [51 QT], nonetheless we prefer to prove 
the result as a direct application of Theorem 12.81 This will be useful in the 
following, where we turn to the analysis of excited states. 

(3.1) Theorem. Let F € C 2 (R k ,R) satisfy (F1)-(F4). Then there exists a 
positive solution of (13. 9|) in Hq(£1). 

Before proving this result, we state in the following lemma some preliminary 
estimates which will be useful also in the next subsections. 
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(3.2) Lemma. Let u G X be such that J' (u)[uiei\ — for every i = 1, . . . , k. 
Then 

J(u) > ^H 2 . 

Moreover, denoting by Cs(Sl,p) the Sobolev constant of the embedding Hq(SI) C 
I? (SI), 

either \\ Ui \\ > {C F C s {Sl,p) p )~ 1,{p ~ 2) or Ui = 0. 
Proof. Recalling the definition of J, the assumption writes 

/ |Viti| 2 dx = / diF(u)uidx, 
Jn Jn 

for every i. As it regards the first part, using equation (|3.10l) we have that 

S 



J(u) > - [ I Vul 2 dx - — !— : / VF(u) -udx = 
2 Jn 2 + d J n 

On the other hand, assumptions (F3) and (Fl) give 



4 + 26 



lull 2 . 



\S/ui\ dx = diF(u)iiidx< / diF(uiei)Ui dx 
n Jn Jn 



<C F J \ Ui \ p dx <C F C s (Sl,p) p (^J \Vui\ 2 dx^J ' . □ 



Proof of Theorem \3.1[ We define 

A = {u € X : Ui ^ for every i} 

and 

V + = {0} , £i(u) = Uiei,i=l,...,k. 
Within this setting we have 



ju e A : 


f \V Ul \ 2 dx= f 




Jn Jn 



i = 1, . . . , k 



so that Lemma I3T2I holds true for any of its elements. Let us check the assump- 
tions of Theorem l2.8l 

(i) The first part of Lemma 13.21 shows that c > 0, while the second part 
implies that J\f \ JV — 0, thus the only thing to prove is that c < +oo, that is 
Af 0. To this aim let u g X be fixed in such a way that Ui > 0, ui ^ 0, 
Ui ■ Uj = for i ^ j. We claim that there exists A € K , with all positive 
components, such that (Axtti, • • • , AfcUfc) £ A/". For each i let us define the 
smooth function 

9i(K) '■= >H / |VM 4 | 2 cfa;- / diF(\ i u i e l )\iU l dx, 
Jn Jn 
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so that the claim is equivalent to the existence of A such that gi(Xi) = for 
every i. On one hand, by assumption (Fl) we have 



9i{\)>K / \V Ul \ 2 dx - X^Cp / ufdi, 
Jn Jn 

which is positive for Xi small. On the other hand, p. lip implies 



<7»(Ai) < Aj / |Vttj| tte + C— / diF(XiUiei)XiUidx 
Jn J{\iUi>ui} 

<X 2 / |V Ml | 2 ^ + C- / Mg£^ (Am ) 2+5 ^, 
7n J{AiUi>«i} 

which, by (F4), is negative for A; sufficiently large. 

(ii) It is a standard consequence of equation (|3 . 10[) (see for example 22 ) . 

(iii) On one hand it is trivial to check that the £Vs are orthogonal, on the 
other hand Lemma \'S. 21 implies that > 5 > 0. 

(iv) Given u <= Af, any vector belonging to V u has the form v — (Aiiii , . . . , X}~U}f) 
for some A € K fe . Hence ^(m)M = XiUiei E V u . 

(v) Let u G Af and v — (Aiiti, . . . , A^ltfe) € V^. Assumption (F2) and the 
definition of Af provide 

J"{u)[v,v]<Y\ I \i\Vui\ 2 dx- (1 + S) V / diF{u)Xjuidx = -8\\v\\ 2 . 
\ Jn l Jn 

(vi) Using assumption (Fl), Holder inequality and Sobolev embedding we 
have, for every v,w € X, and u € Af, 

U'MMW = HI < || V ||, 

|j»MI< / |v w ||v v |cix + c F / K-^i^^dHi + ci^ir 1 )^!!, 



| J"(«) [«,«;]|< / \Vv\\Vw\dx + C F \u\ p - 2 \v\\w\dx <{l + C\\u\\ p - 2 )\\v\\\\w\\. 



We can easily conclude observing that, by Lemma l3.2[ ||u|| is uniformly bounded 

onAfn{J< c + i}. □ 

(3.3) Corollary. For euerj/ 7 C {1, . . . , k}, (i C M. N smooth and bounded do- 
main, there exists a (minimal energy) solution of (|3.9p in Hq((1) such that 
Ui > for i £ 7, Ui = otherwise. 

Proof. It suffices to observe that, letting k = if I and a : |l,...,fc| — > 7 
increasing, then 



satisfies (F1)-(F4) on R k . □ 
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(3.4) Remark. Neglecting assumption (F3), it is possible to use the standard 
Nehari manifold in order find nontrivial solutions with possibly vanishing com- 
ponents. In the setting above, this corresponds to replacing span{wiei, . . . , u^efe} 
with span{u}. Indeed, assumption (F3) is used only in the second part of Lemma 
13.21 which argument can be directly applied to J„ |Vu| 2 dx. The same idea can 
be carried on also in the results below. 

3.2 Multi-bump solutions 

We will prove multiplicity of positive solutions for system Q3.9p when 17 is close 
to the union of disjoint subdomains. More precisely we introduce the following 
notations and assumptions. 

(171) 17 and Oj , I = 1, . . . , n, are bounded regular domains and D is a bounded 
regular open set, such that 

n 

17/ H 17 m = for every 

i=i 

(172) B D 17 is a fixed ball, T/ C <917;, I = l,...,n, are (non-empty and) 
relatively open, such that 

od n r, = 

(03) m G C°°(R N ), I = are such that < rji < 1, 77^0, = 1, and 

rji ■ r) m = for I ^ m. C n > denotes a constant (depending only on D, 
rji,. . . ,r) n ) with the property that 

/ \Vm\ 2 <P 2 dx < C n I \\7ip\ 2 dx for every 996^0(0) (3.12) 
Jn Jn 

(observe that the first integral is actually on D). 

In our construction, we assume O;, Ti and B to be fixed, while D, and hence 
fl and 77/, to vary. From this point of view, since Hq(Q,) C Hq(B), the role of 
B is only to provide Sobolev constants not depending on _D, neither on 17. As 
we mentioned, we consider the case in which D is suitably small, meaning that 
both the Lebesgue measure \D\ and the constant C v above are small. This last 
property is related to the smallness of the TV-capacity of suitable subsets of D, 
and it can be shown to hold, for instance, if D can be decomposed in a finite 
number of parts, each of which lies between two hyperplanes sufficiently close. 

We are going to distinguish different solutions of Q3.9p by prescribing the 
"size" of Ui\n t , for every i = 1, . . . , k and I = 1, . . . , n. More precisely let us fix 
any 

L i c{l,...,n},L i ^0, i = l,...,k. (3.13) 

We will provide a solution such that iti|n; is "large" for / 6 Li and "small" for 
I ^ Li. Due to the arbitrary choice of the sets Li's, this will imply the existence 
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of (2 n — l) fc different positive solutions of system (|3.9p . The size of each bump 
will be classified in relation to the constants 



n : = (^c F c s (n l ,r l , P y 



-l/(p-2) 



where Cs(^i,^i,p) is the Sobolev constant of the embedding Hq r (f2;) C L P (S!/) 
(compare with the constant which appears in Lemma l3.2|) . Let us remark that 
ri is independent of D. We can finally state the main result of this section. 

(3.5) Theorem. Let F £ C 2 (K fc ,K) satisfy (F1)-(F4) and let £1 C M. N satisfy 
(Q1)-(Q3). Assume that the quantities 

\D\, are sufficiently small. 

Then for any L\, . . . , Lk as in (|3 . 13[) there exists a positive solution u of (|3.9p 
such that, for every i and I, 

I |Vwi| 2 dx > rf for I £ Li, / |Vwi| 2 dx < rf for I g Li. 

JQl JQi 

To start with, using the results of the previous subsection, it is easy to 
provide a fc-tuple g of non- negative functions in Hq (UiQi) such that 

— Agi — diF(g%, . . . , and gi\n t is either positive or zero, 

depending on whether I € Li or not (in some sense, one can think of g as the 
required solution, in the singular limit case D — 0). Indeed, for any / one can 
apply Corollary 13.31 with ft = fli and I = {i : I € Li}. Then g is the sum of the 
corresponding solutions. By trivial extension, g € Hq(Q). 
Let us define the constant (independent of D) 

?2 _ , /„ „2 4 + 2<5 



R 2 : =max|||.g|| 2 ,^^J( ff )| + l, 

where 5 has been introduced in assumption (F2). In order to apply Theorem 
lwe define 



\ 

and 



G H^(Q,R k ) : Vi G Hi Ul \ \J Q,)^ | 



£i,l(u) := TjiUiei, i=l,...,k and I G L u 
the latter being smooth on 



{Co |VwJ 2 dx > rf if Z G Li, 
ueX: \\u\\<R, f\ 
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On one hand we have that 



II; ( ; 



1 - ^ m ] + ^2 ViUiSi G K, 



since the first term is in V + and the second one in V u . This in particular 
implies, for every i, 

ueN J'(u)[uiei]=0. (3.14) 
Analogously, for every i and I, 

rifutei G K, (3.15) 

indeed, either it belongs to V + if / ^ Li, or it is equal to {rj 2 — rji)uiei + fftWiej, 
the former belonging to V + and the latter to V~. We deduce that, for every 
w£ JV and / = 1, . . . , n, it holds 



Q = J'(u)[r)i UiBi] = I Vw, ■ V(?7; in) dx - / diF^^mdx, 
which implies 

\V (Tjiu t )\ 2 dx = I d l F{u)rifu i dx + I \Vrji\ 2 uf dx. (3.16) 



Using this property we can prove a result which can be seen as a perturbation 
of the second part of Lemma 13.21 Such result will allow to better localize the 
bumps of the elements of Af. 

(3.6) Lemma. Let \D\, C n be sufficiently small. Then there exist positive 
constants C , £ such that, for every u € Af, it holds 

[ \\7 Ul \ 2 dx>rf => [ \Vui\ 2 dx > (1 + C)rf 
Wu t \ 2 dx < rf => / \Vui\ 2 dx < e 2 , 



where e can be made arbitrarily small with \D\, C^. 
Proof. Using (j3~16l) . (F3) and (Fl) we have 

\Vu t \ 2 dx< I \W(r)iUi)\ 2 dx= / d t F(u)r]fu t dx + / \Vni\ 2 u 2 dx 

Jn Jn 

diF(u)u{dx+ / diF {u)ri 2 Ui dx + I \\7rji\ 2 u 2 dx 
J d Jn 

< [ d l F(u l e l )u l dx + C F [ \u\ p dx + C v R 2 
Jn, J d 



<C F [ \ Ul \ p dx + C F \D\^ 2 "- p ^ 2 ' C S (B,2*)PR P + C ri R 2 
Jn, 

/ r \ p/2 
<c F c s (n h r l ,p)p ^ |VW ' 1 
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where e' denotes a quantity arbitrarily small whenever \D\ and C v are. The 
conclusion easily follows by observing that, denoting by 

h(t) = c F c s (n h T hP yt p -t 2 + e', 

it holds h'{r{) = and h{n) < for e' small. □ 



End of the proof of Theorem \3. 5\ We check the assumptions of Theorem [ 

(i) To start with, we have that c < +00, since g € M . Secondly, by equation 
(|3.14|) . we have that Lemma [3.21 holds true also in the present case, thus pro- 
viding c > 0. Finally, let u € 77 \ TV: then, by Lemma |3"1)1 necessarily |ju|| = R. 
But then, using again Lemma 13.21 and the definition of R we obtain 

J{u) > -^pf 5 R 2 > J(g) > c 

(ii) The same as in the previous subsection. 

(iii) By definition of A we have that ||£i,z( u )ll > rj for every i, I € Li. 

(iv) It follows from (|3~T5|) . 

(v) If u E Af and v G V + then Vi = on for every I £ Li, whereas for 
I Li it holds J n \Vvi\ 2 dx < e 2 where e is defined as in Lemma [3~51 Hence we 
have 

J"(u)[v,v]= I \\7v\ 2 dx- I y2d? F(u)viVjdx-y2 [ E d ij F i u ) v i v j dx 



Ml 2 . 



On the other hand, if v £ V u then v = J2i (S;gl ti-iVi) u ii f° r some tij 6 ML 
Using (F2) and (|3.16p we obtain 

J"(u)[v,v]<\\vf-(1 + S) [ £>F(u)£; da 
= -8\\v\\ 2 + (l + 5) f ]T]T ^iv^i 2 ^ 

° i iGLi 

< -8\\v\\ 2 + (1 + 8)C n / E E ^ul^l 2 dx 



< - 



i i£ Li Jn, l vu d ax Jn, 
S\\v\\ 2 + (1 + 5)C V Y,J2^ I 



< -S + (l + S)C n 



R 2 



2 

2 



min /6Li rf 
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In both cases assumption (v) holds true when \D\ and C n are sufficiently small, 
(vi) the same as in the previous subsection, once one notices that 

||£»MH 2 <2/ (^IVTflf + tflVvil 2 ) d*<(C„ + l)|M| 2 . □ 
Jq 

Proof of Theorem \1. 6 A Since flij = /3ji , system ()1.3|) is variational, with poten- 
tial 

%=i \ j 

It is easy to check that it satisfies assumptions (Fl), (F2), (F4) with p = 4 < 2* 
and 6 = 2. If /3y < for every then it also satisfies (F3), so that Theorem 
13.51 immediately applies. Since (F3) is used only in the estimate in Lemma T3. 61 
(and in its counterpart in Lemma |3. II) we show how to replace that argument 
in case /3y < (3 for every with (3 positive and sufficiently small. We have 

/ d l F{u)u i dx= I [ muf + y^p ij u 2 i u 2 j \ dx<nt u\ dx + j3Ci;{B,4)R 4 , 
Jn t Jn, \ J Jui 

where the last term is arbitrarily small when /3 is. □ 
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